Workload Characteristics of the DAS-2 Supercomputer

نویسندگان

  • Hui Li
  • Lex Wolters
  • David Groep
چکیده

This paper presents a comprehensive characterization of the DAS-21 workloads using twelve-month scientific traces. Metrics that we characterize include system utilization, job arrival rate and interarrival time, job size (degree of parallelism), job run time, memory usage, and job queue wait time. Differences with previous reported workloads are recognized and statistical distributions are fitted for generating synthetic workloads with the same characteristics. This study provides a realistic basis for experiments in resource management and evaluations of different scheduling strategies in a multi-cluster environment.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Comprehensive Workload Analysis and Modeling of a Petascale Supercomputer

The performance of supercomputer schedulers is greatly affected by the characteristics of the workload it serves. A good understanding of workload characteristics is always important to develop and evaluate different scheduling strategies for an HPC system. In this paper, we present a comprehensive analysis of the workload characteristics of Kraken, the world’s fastest academic supercomputer an...

متن کامل

A Comparative Study of Real Workload Tracesand Synthetic Workload

Two basic approaches are taken when modeling workloads in simulation-based performance evaluation of parallel job scheduling algorithms: (1) a carefully reconstructed trace from a real supercomputer can provide a very realistic job stream, or (2) a exible synthetic model that attempts to capture the behavior of observed workloads can be devised. Both approaches require that accurate statistical...

متن کامل

A Comparative Study of Real Workload

Two basic approaches are taken when modeling workloads in simulation-based performance evaluation of parallel job scheduling algorithms: (1) a carefully reconstructed trace from a real supercomputer can provide a very realistic job stream, or (2) a exible synthetic model that attempts to capture the behavior of observed workloads can be devised. Both approaches require that accurate statistical...

متن کامل

A Comparison of Workload Traces from Two Production Parallel Machines

The analysis of workload traces from real production parallel machines can aid a wide variety of parallel processing research, providing a realistic basis for experimentation in the management of resources over an entire workload. We analyze a ve-month workload trace of an Intel Paragon machine supporting a production parallel workload at the San Diego Supercomputer Center (SDSC), comparing and...

متن کامل

Trace-Based Simulations of Processor Co-Allocation Policies in Multiclusters

In systems consisting of multiple clusters of processors which employ space sharing for scheduling jobs, such as our Distributed ASCI1 Supercomputer (DAS), coallocation, i.e., the simultaneous allocation of processors to single jobs in multiple clusters, may be required. In this paper we study the performance of several scheduling policies for co-allocating unordered requests in multiclusters w...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004